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ABSTRACT 

Two 1-week workshops dealing with reading and reading 
related topics were held during the suaser of 1973 by the Kansas 
Mght to Read Project. The workshops were designed to acquaint the 60 
participants with new reading techniques and to prepare then to 
ratnrn to their schools and pass these techniques on to the other 
teachers. Two methods were U5?ed to deternine the effect these 
participants had on their school systems after 1 year: first, a 
reading survey was completed by the teachers in the schools where the 
workshop members taught and second, the workshop participants wrote a 
narrative summary of their year's activities. Data from the teachers 
indicated that their reading programs improved significantly, 
particularly with reference to the use of behavioral objectives and 
reading programs for above and below average students. The workshop 
participants felt they had gained confidence* enthusiasm, awareness, 
and a sense of sharing with regard to the teaching of reading and 
were able to pass a degree of this on to other teachers in their 
buildings. Specific gains were made in establishing inservice 
programs, promoting individualized reading techniques* increasing the 
use of newspapers in the classroom, and developing resource banks and 
skill boxes. (Author/HR) 



it S OCPARTMC^NT Mfi fli TH. 
l?9UCAtlON ft PARC 
NATlOMAl INStiTUICOP 

•I r»0 OanAMl/AtiON . 'BioiN 

NOT Nei'e'SARf r »?l-P«l 
•.t «1.'»FPICIAI NATu'jNAI iMSTitUtEMfr 



KANSAS RIGHT-TO-READ PROJECT 
PROGRAM EVALUATION 
1973-1974 



Report submitted to: 

Wesley Pelsue, Reading Education Specialist, 
Kansas State Department of Education 



Program 



Evaluation Design and Report by 
Don D. Shirley 
September 1974 



TABLE OF CONTENTS 

I Introduction 1 

II Evaluation Design and Procedures 1 

III Results 2 

A. Reading Survey 2 

Table 1 Comparison on Usage of Reading Related 

Activities Pre-Post Program Participation . 3 

Table 2 Comparison of Reading Program Organization 

Pre-Post Program Participation 4 

Table 3 Comparison of Forms of Student Evaluation 

Pre-Post Program Participation > 4 

Table 4 Comparison of Teachers over-all Rating of 
Their Schools Programs Pre-Post Program 
Participation 6 

B. Narrative Report by Workshop Participants 7 

IV Conclusions 8 

APPENDIX A Instrument 10 



ERLC 

J 



K/^NSAS STATE RIGHT-TO-READ PROJECT 
PROGRAM EVALUATION 



I INTROni'CTION 

The state Right-to-Read plan is designed to bring about measurable 
improvements in the reading skills and attitudes of children in Kansas. 
Research has indicated that the classroom teacher is the key to effective 
reading programs. Consequently, the Kansas plan is teacher oriented in 
the form of inservice workshops for classroom teachers. Further 
information on the philosophy and total program is available in the 
Kansas State Department of Education booklet, Kansas Right- to-Read Plan . 

In brief, the basic plan consists of a series of summer workshops 
where a selected group of classroom teachers are exposed to reading- 
related programs, suggestions and materials. These summer workshop 
participants then return to their own school districts and work with 
fellow teachers in implementing these newly acquired skills, ideas and 
programs through local inservice sessions. 

II EVALUATION DESIGN AND PROCEDURES 

The total -evaluation covers two aspects of the Kansas plan; first, 
the effects of the summer workshop and secondly, the influences of the 
workshop participants in their own schools after they have shared 
their workshop experiences for a year with their fellow teachers. 

Attached is the evaluation for the most current summer workshop, 
summer 1974. The evaluation of the summer workshop 1973 was submitted 
last September. 

The second phase of the evaluation procedure was to determine the 
effect of the workshop participants on their fellow teachers and the 
schools reading program and practices with the techniques presented 
during the workshop. Two methods were used to collect this type of 
data; one ^rom the view-point of the participants (a narrative report) 
and the other fropi the viewpoint of the other teachers in the participants 
school (a survey). 

Each workshop participant was asked to respond to two questions: 

a. What do you feel has been the single greatest benefit derived 
from the Right-to-Read workshop? 

b. How has the Right-to-Read workshop effected your school during 
the 1973-74 school year? 
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T^e participants completed the narrative report in May, 1974, one 
year after their summer workshop. 

The second method for data collection, a reading survey, was used 
on a pre-post basis. This survey collected basic information on the 
teachers opinions and attitudes towards selected reading-related variables 
and current practices in their schools reading program. The survey was 
sent to the participants schools before they took part in the workshop. 
May 1973 and then again one year later. May, 1974. This data indicates 
whether the summer workshop participants brought about improvements in 
their schools program as viewed by their fellow teachers. 

To facilitate handling of the data, instead of collecting reading 
surveys on all of the participants schools as was done the fir-^.t year, 
this year only a sample of the schools were taken similar to year. 
To determine the sampling, the list of each of the two summer kshop 
participani:s was alphabetized by their last name, then surveys re sent 
to the school of every fifth name on the list. 

Ill RESULTS 

A. Reading Survey 

Using the sampling techniques, 87 teachers returned surveys in May 
1973 (pre) and 85 teacfiers completed the surveys in May 197^ (post). 
These repre;,ented 11 out of 14 schools for pre-assessment and 10 out of 
14 schools Tor post-assessment. 

As indicated in Table 1, the only area where significant gains were 
made was in the frequency, from often to aaily, of the use of Behavioral 
Objectives by t.'.e teacherc. Greater utilization of libraries and language 
experience; charts were not realized. The use of reading tests and 
magazines had a very slight gain and newspaper usage a slight loss, all 
of which could be contributed to chance of differing responses from the 
same teachers. The daily use of oral reading in the classroom did increase 
so said fr.ore than 20 per cent of these teachers responding ^^o the survey. 

The reading progr?;n organizational patterns of the classrooms did 
not seem to change significantly, as seen by the data displayed in Table 
2, Several of t}>e teachers did not respond to this section on the 
pre-assessment so there was a general lowering of the percentages all the 
way along. If an adjustment had been made for these "no responses" the 
difference between pre and post assessment would become even smaller. 
The only area of major difference is in cross-grade level grouping which 
might have been brought about by a change in building level philosophy 
in the grouping of students for reading. 
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TABLE 2 

COMPARISON OF READING PROGRAM ORGANIZATION 
PRE-POST PROGRAM PARTICIPATION 



Organization activity 


Pre 


Post 




ReadinQ instructions aiven to whole class 
at the same time 


38% 


32% 


Grouping of students by achievement 


73% 


72% 


Grouping of students by common interests 


11% 


9% 


Individualized instruction 


68% 


65% 


Cross-grade level grouping 


16% 


5% 


Basal reading textbook 


48% 


47% 


Basal reader and supplementajry readers 


79% 


71% 


Non-basal reader approach 


32% 


22% 


Reading instruction given in content-subject areas 


13% 


9% 


Others 


13% 


7% 




T/^BL:! 3 

COMPARISON OF FORMS r.f STUDENT EVALUATION 
PRE-POST PROGM PARTICIPATION 




Form of Evaluation 


Pre 


Post 


Commercially procTuced standardized achie./ement tests 


61% 


54% 


Commercially produced standardized diagnostic tests 


47% 


44% 


Informal reading Inventories 


40% 


45% 


Basal reader textbook tests 


51% 


64% 


Teacher-made tests 


66% 


69% 



Other 



19% 7% 
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Table 3, forms of student evaluation, does show some slight changes. 
This data would indicate a shift from standardized tests to more of a 
criterion reference testing approach, as seen in the increase uses of 
teacher-made tests, basal reader tests and informal reading inventories. 

Before the Right-to-Read workshop participants returned to their 
buildings, half of the teachers v/ere familiar with the Right-to-Read 
program. By the end of the year, 87% knew about the program. 

The number of teachers familiar with behavioral objectives did not 
increase significantly (pre-78% and post 8Z%) as a result of the participants 
exposure to this concept. Most teachers had heard of behavioral objectives 
in college courses. There was a greater awareness of behavioral objectives 
from fellow teachers (pre-16% and post 33%), possibly Right-to-Read partici- 
pants, after the participants had worked a year in the schools. This 
trend can also be seen in Table 1 by the increased use of behavioral 
objectives i- the classroom. 

The data from the semantic differential scales Indicate: 

a. That there was no real change in the reading programs designed 
for the average students between the pre and post assessment periods. 

b. The teachers indicated that the reading program for the below 
average student did improve during the year. The increase in adequacy 
and appropriateness improved slightly: Adequate Pre, 41%; Post, 56% and 
Appropriate Pre, 32%; Post 45%. At the time of the pre-assessment 

fewer than half of the teachers felt the program was fun (38%) or meaningful 
(45%). After a year these percentages increased greatly: 
fjn (60%) and more meaningful (71%). 

c. The teachers indicated there was slight improvement in the 
program for the above average students. These programs became a little 
more appropriate (pre-53% and post 69%), more adequate (pre-44% and 
post 58%) and more fun (pre-47% and post-73%). 

d. The items related to diagnosing reading problems did not change 
much except in the arQa of appropriateness, pre-40% and post-59%. 

All of the teachers completing the survey were asked to rate the 
over-all effectiveness of their schools reading program. On both the 
pre and post assessment, the programs means indicated a rr.ting of average 
to good. As seen in Table 4, the mean score on the pre-assessment was 
6.21 and on post it was 7.10, which does show an increase in improving 
their programs. The change in rating is significant though when you 
compare the cumulative percentages of rating on pre only 2% of the teachers 
ranked their reading program as outstanding, scores 9 or 10, while on 
the post-assessment 13% of the teachers rated it outstanding. Almost 
half of the teachers ranked their reading programs as good to outstanding 
after the Right-to-Read participants had been in their schools for a 
year, whereas before that time only about one-fifth of the teachers rated 
it this high. 
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B. Narrative Report by Workshop Participants 



Each of the participants were asked at the end of the school year 
after their summer workshop to respond to two questions: 

a. What do you feel has been the single greatest benefit derived 
from the Right- to-read workshop? 

b. How has the Right-to-read workshop effected your school during 
the 1973-74 school year? 

Twenty-one (21) of the thirty (30) participants responded to 
these two questions. 

Four words appeared over and over in the participants responses to the 
first question dealing with benefits they derived from the workshop; 
confidence, enthusiasm, awareness and sharing. Almost all of the participants 
used at least one of these terms in their writings. The "confidence" was 
their willingness and confidence to try some of the new techniques and 
approaches they had been exposed to. They felt the workshop gave them 
the "enthusiasm" needed to go out and put into practice what they had 
learned. They became more "aware" of the reaaing process and the needs of 
the individual students. They were particularly vocal about the sharing 
and exchange of ideas between the participants and between the participants, 
speakers and workshop director. 

Other benefits mentioned were the variety of approaches they learned 
to cope with reading problems of the students which were very practical and 
the wealth of material they received at the workshop and since in The 
Nitty Gritty . 

The only two workshop topics specifically mentioned were the 
individualized reading techniques, humanizing the classroom suggestions and 
recommendations on how to use the newspaper in the classroom. 

Quotes from two of the participants narrative reports best illustrate the 
general tone of their collegues sentimfsnts: 

"For me pei-sonTilly, the days I spent at Right- to-Read gave me a 
renewed desire to endeavor to be a better reading teacher. The 
association with the other participants had to send one home, 
with many new ideas and a fresh outlook on the everyday problems of 
teaching." 

"The greatest benefit were the variety ways of teaching children 
to read. Giving me more confidence, and enthusiasm to try new 
ways to reach each child. " 
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In responding to what effect the Right- to-Read workshop has had 
on the districts, most participants indicated an increasing in the sharing 
of ideas and the cooperation between teachers. Seven participants 
specifically mentioned starting inservice programs or greatly expanding 
existing programs. They have encouraged other teachers to go to the 
Right- to-Read drive in conferences (one said she loaded 5 in her car and 
went to the Junction City program), to hear specific speakers at reading 
conferorces and KNEA convention, and to take their principals to the 
Wichita Right-to-Read meeting. 

As to specific topics covered in the workshop, 8 said they had 
promoted the use of the newspapers in the classroom, 9 helped organize 
individualized reading programs or pushed techniques related to them, 
9 also 9 mentioned the establishment of skill boxes .n their buildings, 
4 said that behavioral objectives were being used for the first time 
or on the increase, 5 had started using perceptual training techniques 
and 3 felt they were making better use of parent volunteers. 

Several single items were mentioned as benefits to the district: 

a. Two teachers in one district had received a mini -grant from the 
state department. 

b. The superintendent in one district has become interested in 
criterion reference and mastery tests. 

c. A classroom with 4 typewriters for students use has been set 
up in one building. 

Most teachers have said the greatest effect has been on their own 
classroom teaching. This is best expressed by the following statement 
from one of the participants: 

"First of all. Right to Read gave me a new confidence in myself as 
a teacher. I now feel more at ease sharing ideas with others. 
I feel that I am a more conscientious teacher of reading." 

IV CONCLUSIONS. * 

The reading survey data does not seem to show as great an effect 
on the workshop participants schools this year as it has in the past 
years. The overall rating of the improvement in the schools reading 
program does show an increase but this is not significantly reflected 
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when asked about specific aspects of the reading programs and activities. 

The teachers do indicate their programs for the below and above 
average students have been improved slightly. This is probably as 
the result of an increase in the use of individualized reading techniques. 

As stated previously the greatest value of the Right-to-Read workshop 
has been the increase of confidence, awareness, enthusiasm and sharing 
of the participants. These are concepts which are difficult to furnish 
hard statistical data on. Thpse are the ingredients which go into 
making a stronger teacher and as research has indicated the teacher 
is the key in the students learning process. 

The following statement from one of the participants cites the 
benefits of the workshop and- the sense of cooperation which it encourages: 

"The greatest benefit from Right- to-Read in our district has been 
a working together, a sharing, a feeling of being one group. We are 
far apart in miles and the Right-to-Read workshops have brought us much 
closer together. " 
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KANRAH RTr,HT-TO-W:Al) IWChAM KVALUATTON 



In an effort to collect dnta on ronrtinR prof'.rnjiis , w« nre request ing that you 
complete the following survoy. 'Hi is dnln will l^e used n croup analvsis only; 
there Is no need for you to i'.icn yoiu name or Identify your nchi>ol. Please 
give your honost opinions to the Items i>elow. 

Return the complete survey to: 

Your district USI) f 



Don I). Shirley 

t;00l H«uscr district ua«,o 

ChHwnee, Kansas r)621o 

Thank you for your cooperation. 



Section T: 



A. Teacher I'rincipnl 

B. Will you be i-eturninp: to your prf>sont building; to tenrh or administer 
for the 197A-75 school year? Yes No 

0. Tndirite the grade level in whi<.h vou teach 



Section TI: 



A. 
B. 

C. 



Are you familiar vl »h the Kansas I>inht.-to-F>-«d proprw.'i Yes 

Are yo\i famll iar wi th the roncept of using l.f»lmv lorul ot..iootives in 
teaching? Yes No 

If you answered YK:" on item 2, how did yo\» learn *<>.out behavioral 

ob.lectives? Poolt Magatdne College-university course 

Other sourre (specify) 



IIo 



Administrator 



other teachers 



D. How frequently do you use the following items in yo\ir prenent reading program? 



Imily 



Weekly 



Oft.en 



/.(WJ times 



Geldon 



Never 



Behavioral ob.iectivos 



Libraries 



Diagnostic reading 
tests 



Kducational TJ 



Newspapers 



Magazines- News 1 et ters 



Oral reading 



I.angunfrf.' cxperieri' " 
rhnrtc 
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E. How is your redding progr.^m organized? (Check more than one if needed.) 

Reading instructions given to whole class at the same time 
Grouping of st'jdwts by cu.hievenitnt (How many nroups do you 
usually have'.' _ 

Grouping of studL-hT'. by corrr.on interests 

Individualized instruction 

Cross-grade level rjrcupinf) 

Basal reading toJStbook 

Basal reader and supplementary readers 

Non-basal reader approach—utilizes primarily other reading 

naterials (library books, Rew:>papers, magazu.es. language 

experience charts, etc.) 

Reading instruction given in content-subject areas and not a 
separate reading period 
Other (specify) 



F. Which of the following forms of student evaluation do you use in your 
reading program? (Check more than one if needed.) 

Commercially produced standardized achievement tests 

Commercially produced standardized diagnostic tests 

Informal reading inventories 

Basjl reader textbook tests 

Teacher-made tests 

Other (specify) 



In the next section, please mark once on each line for the following items: 
G. Our present reading program for the average student is: 



HARD 
APPROPRIATE 
INADEQUATE 
FUN 

MEANINGFUL 



VERY : 


SORT OF : 


NEITHER : 


SORT OF : 


VERY 











































EASY 

INAPPROPRIATE 

ADEOUATE 

DULL 

MEANINGLESS 



H. Our present reading program for the below average student is: 



HARD 
APPROPRIATE 
INADEQUATE 
FUN 

MEANINGFUL 



VERY : 


SORT OF : 


NEITHER : 


SORT OF : 


VERY 











































EASY 

INAPPROPRIATE 

ADEOUATE 

DULL 

MEANINGLESS 
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I. Our present readinq pro'jram for the aHoye averaq^^ student is: 



VERY 



HARU 
APPROPRIATE 
INADEQUATE 

ruN 




VE'>Y 



MLANIMGFIJL 














J. Diagnosing reading problems for individual 


students is: 




VERY : 


SORT OF ; 


NEITHER : 


SORT 


OF : 


VERY 


HARD 














APPROPRIATE 












INADEQUATE 










FUN 

MEANINGFUL 























EASY 

INAPPROPRIATE 

ADEQUATE 

DULL 

MEANINGLESS 



EASY 

INAPPROPRIATE 

ADEQUATE 

DULL 

MEANINGLESS 



K. 



How would you rate the overall effectiveness of you school s reading 
program in achievim the goal of providing each child 
skills and attitudes appropriate to his capabilities? (Circle the 
appropriate nuirber on the scale balow.) 



10 9 
Outstanding 



"8 7 ■ 
Good 



6 5 
Average 



Fair 



1 

Poor 



Any comments on your reading program are welcomed; 



